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Abstract 

To provide a more accurate description of the driving behaviors in vehicle queues, a namely 
Markov-Gap cellular automata model is proposed in this paper. It views the variation of the gap 
between two consequent vehicles as a Markov process whose stationary distribution corresponds to 
the observed distribution of practical gaps. The multiformity of this Markov process provides the 
model enough flexibility to describe various driving behaviors. Two examples are given to show 
how to specialize it for different scenarios: usually mentioned flows on freeways and start-up flows 
at signalized intersections. The agreement between the empirical observations and the simulation 
results suggests the soundness of this new approach. 
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I. INTRODUCTION 



Traffic flow is a many-body system of strongly interacting vehicles. Various models are 
presented to understand the observed rich variety of physical phenomena exhibited by traffic 



flow [l| 



2|, 0]. From the viewpoint of vehicles' queuing dynamics, these models generally 
depict four kinds of traffic flows: 1) static queues (e.g. vehicles parked on a line {4], js], 
, and vehicle queues fully-stopped in front of signalized intersections [8]), 2) stable 
moving queues (vehicle platoons) which includes the well-known Kerner's synchronized flow 
and wide-moving jams [9!], 3) free-flows formulating no explicit queues, and 4) unstable 
queues which contains complex inter-arrival and inter-departure queuing interactions flo| . 



10( 1 , I2J . Differently in [l3| , random 



The queues with complex interactions between its elements attract increasing attentions 
recently. In many known approaches, the dynamics of flows are described on N strongly- 
linked particles under fluctuations ^, [3I. Since the governing interaction forces or potentials 
are not directly measurable for traffic flow applications, the statistical distributions of parti- 
cles are often investigated instead. For example, the im por t ant phase transition phenomena 
of traffic flow were studied by using scattering theory in 
matrix theory was applied to predict the space-gap distribution between vehicles in three- 
phrase flows. However, these studies focus on the steady-state statistics. Two questions 
thus arise as: 1) can we design microscopic simulation models (e.g. car-following, cellular 
automata) that meanwhile yields such statistical properties; 2) how to depict the transient- 
state statistics of inter-arrival and inter-departure queuing interactions. This paper aims to 
propose a simple yet useful CA model to partly answer these two questions. 

In the fleld of traffic flow modeling, cellular automata (CA) based microscopic traffic 
simulation has received constant interests in the last decade, because of its efficiency on fast 
simulation and ability to imitate the driving behaviors to explain some complex phenomena 
llJl. However, many CA models are designed to study the phase transitions of traffic flow 

n n 

only, i.e. [15|], pj[. The rather low accuracy on vehicles' velocity and acceleration, which is 
useful in computer implementations, prevents them to incorporate further more features. 

To deal with this problem, a new CA model is proposed in this paper. It models the 
variation of the gap between two consequent vehicles as Markov process, whose stationary 
distribution can be designed to reflect the distribution of empirical gap data. Because it is 
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a dynamic model, it can simulate the inter-arrival and inter-departure queuing interactions, 
too. Moreover, the velocity adjusting rule can be gotten in a concise and unified way, which 
contains no intractable formulations and fits for fast simulations. 

To prove its soundness, this general model is specialized to explain the interesting phe- 
nomena of traffic breakdown of freeway traffic fiow and departure headways at signalized 
intersections. The agreement between the empirical and simulation results indicates that 
this new model approvingly reveals the implicit interactions between queuing vehicles. The 
results also prove the statement given in 10|] that the interdeparture time statistics is dom- 
inated by spatial interactions among the elements in a queue rather than the arrival or exit 
processes for a relatively long queue. 



II. THE MARKOV-GAP CA MODEL 



The model proposed here is a multi-cell CA model on a unidirectional, single-lane lattice, 
in which a vehicle is allowed to span a number of consecutive cells in the longitudinal 
direction; see Fig. [H Multi-cell type is chosen here for modeling the possible small gaps 
during slow moving scenarios. 
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FIG. 1: Diagram of the mutil-cell CA model. 



Usually, CA models of road traffic contain two modes: free-driving mode, following/ 
braking mode. In the following/braking mode, a driver adjusts his/her vehicle to keep an as 
close as possible but not too close distance gap. Due to various reasons (inability to predict 
the leader's action or make precise driving actions, possibility to be absent minded, etc.), 
he/she cannot maintain a constant gap. Suppose altogether we have possible gaps whose 
lengthes range from cell to (A^ — 1) cells. If at time t, the length of the gap is n\ at the 
next time (t + 1), the length may still remain n, or possibly change to an adjacent value, 
i.e. (n — 1), (n + 1), etc. 



Abstractly, this variation process of a gap during following can be viewed as a transferring 
process between states, where each state denotes a distinct gap in length. Statistically, 
considering the relatively long-time driving behaviors of many drivers, the transferring prob- 
ability from state i to j would approach a steady value. That is, the drivers' car-following 
actions can be depicted by a Markov Chain characterizing the variation process of gap. To 
our best knowledge, only 17| proposed a state-transition model similar to this model in a 
vague way, but it does not mention the Markov transferring probability. 

Notice that the above Markov Chain is positive recurrent and aperiodic, it yields a steady- 
state (stationary) distribution, which straightforwa rdly corresponds to the empirical distri- 
butions of gap distance in traffic flow applications 18|], 19|. This makes the model able to 
yield expected statistical features on gap/headways. 

Indeed, it is not required to discretize the steady-state distribution into the minimal 
division level (the length of a cell here), because to consider too many transition states 
would be unnecessary and time consumin g. In this paper, the so called Markov Chain 
Aggregation technique used in 201], 21[, 22] is employed to combine some neighboring 
states and thus simplify transition matrix. Without losing much generality, we can further 
assume that a state (may span a number of consecutive cells) can only transfer to itself or 
the strictly neighboring state (noticing the simulation time span is usually short and the 
speed is limited, this assumption is reasonable). Thus, the transition matrix of the Markov 
Chain can be written into a tridiagonal matrix as: 



ro go ■■■ 
Pi Ti qi ■ ■ ■ 

P2 r2 q2 : 







pn-i r„_i 



(1) 



where pi, rj, qi are the probabilities that transfer from state i to the lower, current and 
higher states, respectively. 
Let po = qn-i = 0, we have 



Pi + ri + qi = l 



(2) 



for i e {0,1,...,A^- 1}. 
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As well known, there exist numerous solutions for the potential transition matrix ([T]). 
Clearly any a valid solution could be used for simulation, but we generally have two more 
requirements for constructing Markov Chain for simulations: 1) lower time complexity of the 
formulation algorithm; and 2) faster convergency speed of the obtained Markov Chain, since 
it determines how many rounds of simulations are needed before drawing a satisfactory 
conclusion 20|], 23|]. To meet these two requirements, we can formulate such a matrix 



construction problem into a Semidefinite Programming (SDP) problem (e.g. SDP-(19) in 



2J|), which is easy to solve. In the rest of this paper, let's assume the associated transition 
matrices ([H) have already been obtained, since how to derive such a matrix does not accord 
with the main theme here. 

Suppose the gap between the {i — l)th and ith vehicle is in the nth state at time t, which 
indicates that the gap of the ith vehicle satisfies gi(t) G [Qn"^, g'^]. Here, g''°'^ and g"!^ denote 
the lower and upper boundaries of the nth state, respectively. 

Based on the above Markov transition idea, the gap might be enlarged into the (n + l)th 
state with probability due to deceleration. In the simulation, an arbitrary random number 
g^{t+l) will be uniformly generated in [gn+i^ S'n+i] ^'^d assigned as the potential forthcoming 
gap. And the expected velocity Vi of the zth vehicle at time {t + T) should be 

^{t + T) = v,.^it) - [^(t) - g,it)]/T (3) 
Similarly, when acceleration, the velocity should be adjusted as 

^{t + T) = v,_,it) - [^(t) - g,it)]/T (4) 

where g[{t) e [gl^^,, gZi]- 

Noticing most CA models of road traffic consists of an accelerating rule to make the 
vehicle approach the highest possible speed and a braking rule to avoid collisions, we can 
similarly write the whole updating rules as: 

1) If gi(t) > Gmax, where Gmax denotes the maximum coupling distance; the vehicle is in 
free-driving scheme, then it will approach the highest velocity as 

Vi(t + T) = mm{vi{t) + a+„^ x T, Vmax} (5) 
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Else if Vi(t) —Vi^i(t) > [gi(t) —G]/H, there exists a risk to collide, and thus let the vehicle 
brake 



Vi{t + T) = v,{t)-DxT (6) 

where G, H and D are constants denoting the minimum safety gap, deceleration time and 
braking decelerating rate, respectively. 

Otherwise, the velocity of the vehicle is updated as follows, where the max, min functions 
are added to guarantee that the velocity and ac/decelerating rates are within the limits. 

r , 

min{fi(t) + a+„^ x T, f +(t + T),Vmax} , with 
Vi{t + T)= I Viit) , withr, (7) 

max{vi(t) - a"^^ x T,v~ {t + T),0} , with g„ 

V 

2) The position of vehicle is then updated as 

Xi{t + T) =Xi{t)+Vi{t) xT (8) 

Simulations show that the multiformity of this Markov process provides the model enough 
flexibility to describe diversified driving behaviors. The transferring matrix can be explic- 
itly determined by the investigation data from drivers or implicitly estimated through the 
observed distribution of gap. 

However, the above model should not be directly applied, if the velocity of vehicles varies 



in a relatively large range. This is primely because drivers wou 



constant time headway instead of gap distance. (As shown in jo], [13||, the time-headway 
distributions computed for the free-flow, synchronized flow, and moving jam traffic phases 
do not differ too much in shape and mean values.) Usually, the larger the velocity is, the 
larger the gap distance should be. Thus, the aforementioned transition matrix ([T])) should 
be modified to be velocity-dependent in such situations. Examples of implementing this 
trick will be shown in the coming sections. 



d like to keep a roughly 



III. A SPECIALIZATION FOR FLOWS ON FREEWAYS 

To illustrate the effectiveness of the proposed model, a specialized form is used to repro- 
duce spontaneous traffic breakdowns and moving jams that have been observed for flows 
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on freeways. The velocity of a vehicle may vary significantly in such situations. However, 
to assign a Markov matrix for each velocity (more precisely to make the model into a 
time-dependent continuous time Markov process) is troublesome for fast simulations; thus 
the aggregation idea is used again. 

Suppose we only consider J Markov Chains, each of which corresponds to a certain range 
of velocity. When the velocity of the ith vehicle Vi{t) fall into the jth velocity range at time 
t, we will apply the jth Markov transition matrix in velocity updating. In the following 
simulation, five transition matrices are designed (in a sense to the five speed stages of a car); 
see Fig. [21 All the five distributions are uniformly discretized histogram (5 segments, 3.3m 
per segment for velocity range [0, 9]; 4 segments, 4.1m per segment for velocity range [9, 18]; 
and 3 segment, 5.5m per segment for the rests). The discretized stationary distributions are 
assigned as Table. [T]with respect to the practical observations |l^, |ll|, 13]. The associated 
Vmax in & and ([7]) are also set the 9m/s, 18m/s, for each range respectively. 




Gap (m) 



FIG. 2: The assumed discretized steady-state gap distributions according to different velocities. 



Here, the length of each cell is set as 0.1m. The length of each vehicle is uniformly set 
as 4m. The maximum coupling distance between two consecutive vehicles is set as 52.5m, 
which means the follower will enter free navigation mode if the gap to its leader is greater 
than 52.5m. 

The velocity is updated once T = Is. The maximum velocity of a vehicle is set to Vmax = 
45m/s, the maximum accelerating rate is a^^^ = 7.5m/s^, and the maximum decelerating 
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TABLE I: The discretized gap distributions according to different velocities. 



Index 



Velocity range(m/s) 



Gap range(m) 



Probability in each segment 



1 
2 
3 

4 

5 



[0,9] 
[9,18] 
[18,27] 
[27,36] 
[36,54] 



[0.5,17] 
[9,25.5] 
[18,34.5] 
[27,43.5] 
[36,52.5] 



[0.10,0.35,0.32,0.20,0.03] 
[0.30,0.33,0.28,0.09] 
[0.42,0.45,0.13] 
[0.41,0.0.45,0.14] 
[0.41,0.43,0.16] 



rate is a^^^ = 15m/s^. A fully stopped vehicle will start to move only if the gap ahead is 
greater than 2.2m. And the braking parameters are set as G = 0.5m, H = 7s, D = 15m/s^. 



o local measurement 
globle measurement 
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FIG. 3: The {k,Vs) diagram for the proposed model, obtained by local and global measurements. 

Fig. [3] and Fig. H] show the {k, Vg) and {k, q) diagrams for the proposed model, obtained 
by local and global measurements. These microscopic traffic stream characteristics are 
measured according to \}\- Here, Kg denotes the length of the closed single-lane system, 
which is 27000m. It can be seen from Fig. [3] that the local measurements interestingly tend 
to form clusters around certain space-mean velocities, which corresponds to the so called 



optimal velocities predicated in 



251 ]. [261 ]. [271 ]. These clusters appear as branches in Fig. HI 




FIG. 4: The {k,q) diagram for the proposed model, obtained by local and global measurements. 

too. This indicates that the most important merit of the optimal velocity models has been 
inherited by the proposed model, though via a different interpretation of the dynamical 
equilibrium between traffic flow velocity and density. Moreover, it yields the right headway 



distribution as observed other than that given in Fig. 7 of [25 1. 

Besides, the local measurements in Fig. H] also discriminate Kerner's three-phase flows: 
the free-flow regime contains only a few data points on line starts from the original point; 
the synchronized regime is visible as a wide scatter of the data points, having various speeds 
but relatively high flows; and synchronized- flow, and jammed regimes contains the data 
points in the wide- moving jam correspond to Kerner's line J. Thus, the proposed model 
can reproduce the traffic phenomena of phase transitions formation observed in real traffic. 

It should be pointed out that the highest flow rate of the proposed model is larger than 
that of NaSch model [l^, mainly because of the different settings of vehicle's length. 
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IV. ANOTHER SPECIALIZATION FOR START-UP FLOW AT SIGNALIZED IN- 
TERSECTIONS 



Another specialization is proposed in this section to explain the distributions of the 
observed departure headway. Results indicate that the proposed model can also depict the 
transient-state statistics of unstable queues. 

Departure headways are usually defined as the times that elapse between consecutive 
vehicles when vehicles in a queue start crossing the stop line (or any other reference line) 
at a signalized intersection after the light turns green. Modeling departure headways at sig- 
nalized intersections attracts constant research efforts due to its importance. Most previous 
works focus on the mean departure headways of the first tens of vehicles. The results show 
that the headways tend to decrease sequentially as queue position increases, and a steady 
headway will be reached since the fourth or the fifth vehicle, i.e. [3], {28]. Further 
investigations shows that each of these departure headways follows a log-normal distribution 
(whose logarithm is normally distributed) respectively and their mean values decrease to a 
saturation value gradually [29|], 30|; see Fig. [5l 

Only the movements of the first few vehicles, which are fully stopped when the light 
turns green, are recorded and examined. The vehicles whose length is too long (more than 
10m) are discarded as well as their following vehicles. The sample sizes decrease according 
to the positions due to this data pre-processing process. The statistics of the observed 
departure headways are listed in Table. [Tll Kolmogorov-Smirnov (K-S) hypothesis test is 
used here to check whether the empirical distributions are similar to the estimated log- 
normal distributions, and Jarque-Bera (J-B) hypothesis test is used to check the departure 
of the distribution of empirical headways' logarithm from normality [31]. The criteria level 
is set as 95%, which means the hypothesis will be accepted if the value is greater than 0.05. 

By specializing the above Markov-Gap CA model, we can give a explanation of such 
phenomena. Here, the length of each cell is set as 0.1m. The length of each vehicle is still 
4m. Here, only four transition matrices are designed; see Fig. El All the four distributions are 
uniformly discretized into 9 states (9 segments, 2m per segment) discretized histogram. If 
the velocity of a vehicle lies in [0, 4]m/s, then the gap variation process is assumed to follows 
the log-normal distribution with mean 1.9 and stand deviation 0.8. After discretizing, the 
allowable gap range is divided into 9 monospaced states between 2m to 20m. Similarly, we 
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Time headway (s) 

FIG. 5: The empirical distributions of departure headways identified from the histograms observed. 
The departure headway data used here are collected from several intersections in Beijing, China 
during 2006 to 2007 by using video cameras. The recording time is from 9:00 AM to 10:00 AM, 
when the traffic flow is not too crowded. The queuing length does not grow so long (typically 5 ~ 9 
vehicles) in this period. 

have the other settings as shown in Table. IIIII The maximum coupling distance between 
two consecutive vehicles is set as 27m. 

The initial gaps of the vehicles are assigned as random numbers following a normal 
distribution {fimitgap = l-7m, dinugap = 0.1). The velocity is updated once T = 0.50 ~ 0.70s 
randomly, because human drivers usually cannot make decision or take action in a too short 
time). The maximum velocity of a vehicle is set to Vmax = 16m/s here, and the maximum 
ac/decelerating rate is a^^^ = a~„^ = 6m/s^. And the braking parameters are set as 
G = 0.5m, H = 12.5s, D = Gm/s^. 

Before the simulation, all the vehicles are fully stopped. And the departure of a vehicle 
starts one by one (a vehicle will start to move only if the gap ahead is greater than 2.2m). 
The first vehicle will steadily accelerate to 16m/s in the 16s (accelerating rate Im/s^) and 
then keep this speed. 
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TABLE II: The Kolmogorov-Smirnov (K-S) and Jarque-Bera (J-B) hypothesis testing results of 
empirical departure headways, and a denote the mean and standard deviation of the logarithm 
of data respectively. 



Postion 


Sample size 


K-S test 


J-B test 




0" 


2 


423 


0.4282 


0.2730 


1.0569 


0.3353 


3 


423 


0.3788 


0.3089 


0.9639 


0.3210 


4 


422 


0.1684 


0.3028 


0.8920 


0.3171 


5 


416 


0.3050 


0.3157 


0.8701 


0.3163 


6 


394 


0.4635 


0.3657 


0.8089 


0.3127 


7 


298 


0.3261 


0.1849 


0.7372 


0.2991 


8 


146 


0.8587 


0.1060 


0.6670 


0.2996 


9 


42 


0.8544 


0.5000 


0.5849 


0.2945 




FIG. 6: The assumed discretized steady-state gap distributions according to different velocities. 

Results below show that the resulting mean departure headways (400 rounds of simu- 
lations for several times) following a similar but faster decreasing pattern to the empirical 
ones; see Fig. [71 The statistics of a set of simulated departure headways are given in Ta- 
ble. HV] (the criteria level is still 95%). The simulated headways do not decrease exactly 
like empirical ones, partly because: 1) the empirical samples for the last few positions are 
limited and may be biased, 2) the simple braking rule ([5]) is still not accurate enough to 
depict the real tracking dynamics. More efforts will be put into here for better concordance 
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TABLE III: The designed discretized log-normal type gap distributions according to different ve- 
locities, p, and a denote the mean and standard deviation of the logarithm of data respectively. 



Index Velocity range(m/s) Gap range(m) /i a 

1 [0,4] [2,20] 1.9 0.8 

2 [4,8] [4,22] 2.2 0.7 

3 [8,12] [7,25] 2.5 0.5 

4 [12,16] [9,27] 2.7 0.45 



between the empirical and simulated data. However, it is apparent that this model captures 
the main features of the driving behaviors in a discharging queue and therefore yields an 
accordant macroscopic statistic result through a minimal description of their microscopic 
interactions. 




Time headway (s) 



FIG. 7: The distributions of a typical set of departure headways identified from the histograms 
obtained in simulation 

Further simulations also reveal that: 

1) The general shapes of the simulated departure headways distributions will be roughly 
kept according to different aggregation ratio, unless the number of states is too small. This 
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TABLE IV: The Kolmogorov-Smirnov (K-S) and Jarque-Bera (J-B) hypothesis testmg results of 
a typical set of simulated departure headways/i and a denote the mean and standard deviation of 
the logarithm of data respectively. 



Postion Sample size 


K-S test 


J-B test 


u 

A* 


a 


2 400 


0.7525 


0.0325 


0.9623 


0.2993 


3 400 


0.3678 


0.0501 


0.8540 


0.3211 


4 400 


0.6651 


0.0706 


0.8283 


0.3268 


5 400 


0.5992 


0.2564 


0.7336 


0.3104 


6 400 


0.7980 


0.3834 


0.6992 


0.3035 


7 400 


0.8780 


0.1100 


0.6413 


0.2726 


8 400 


0.6681 


0.7080 


0.6520 


0.2673 


9 400 


0.0912 


0.1979 


0.6265 


0.2595 



proves the Markov Chain Aggregation technique in ([T]) is applicable. 

2) The variation trend of mean departure headways is not very sensitive to the initial 
positions and velocities of the vehicles, which fits the facts observed. 

Acknowledgments 

This work was supported in part by National Basic Research Program of China 
(973 Project) 2006CB705506, Hi- Tech Research and Development Program of China (863 
Project) 2006AA11Z208, and National Natural Science Foundation of China 50708055. 



[1] D. Chowdhury, L. Santen, A. Schadschneider, Phys. Rep. 329, 199 (2000). 

[2] D. Helbing, Rev. Mod. Phys. 73, 1067 (2001). 

[3] R. Mahnke, J. Kaupuzs, I. Lubashevsky, Phys. Rep. 408, 1 (2005). 

[4] J. W. Lee, Physica A 331, 531 (2004). 

[5] S. Rawal, G. J. Rodgers, Physica A 346, 621 (2005). 

[6] B. S. Kerner, S. L. Klenov, A. Hiller, and H. Rehborn, Phys. Rev. E 73, 046107 (2006). 

[7] A.Y. AbubMagd, Physica A 368, 536 (2006). 

14 



[8] X. Jin, Y. Su, Y. Zhang, L. Li, larXiv:0803.26T9] 

[9] B. S. Kerner, The Physics of Traffic (Springer, Heidelberg, 2004). 
[10] D. Helbing, M. Treiber, A. Resting, Physica A 36, 62 (2006). 
[11] M. Schonhof, D. Helbing, Tmnsp. Sci. 41, 135 (2007). 
[12] M. Krbalek, D. Helbing, Physica A 333, 370 (2004). 
[13] A. Y. Abul-Magd, Phys. Rev. E 76, 057101 (2007). 
[14] S. Maerivoet, B. De Moor, Phys. Rep. 419, 1 (2005). 
[15] K. Nagel, M. Schreckenberg, J. Phys. I 2, 2221 (1992). 
[16] D. Helbing, M. Schreckenberg, Phys. Rev. E 59, 2505 (1999). 
[17] B. Son, T. Kim, T. Lee, in Lecture Notes in Computer Science 3481, 863 (2005). 
[18] R. T. Luttinen, Transp. Res. Rec. 1365, 92 (1992). 

[19] P. G. Michael, F. C. Leeming, W. O. Dwyer, Transp. Res. F, 3, 55 (2000). 

[20] W. J. Stewart, Introduction to the Numerical Solution of Markov Chains, (Princeton Univer- 
sity Press, Priceton, 1994). 

[21] W. M. Spears, in Proceedings of the Congress on Evolutionary Computation, (1999). 

[22] G. Bolch, S. Greiner, H. de Meer, K. S. Trivedi, H. de Meer, K. S. Trivedi, Queueing Net- 
works and Markov Chains: Modeling and Performance Evaluation with Computer Science 
Applications, 2nd ed., (John Wiley and Sons, 2006). 

[23] S. P. Meyn, R. L. Tweedie, Markov Chains and Stochastic Stability, (Springer- Verlag, New 
York, 1993). 

[24] S. Boyd, P. Diaconis, and L. Xiao, SIAM Review 46, 667 (2004). 

[25] M. Bando, K. Hasebe, A. Nakayama, A. Shibata, Y. Sugiyama, Phys. Rev. E, 51, 1035 (1995). 

[26] D. Helbing, B. Tilch, Phys. Rev. E 58, 133 (1998). 

[27] R. Jiang, Q. S. Wu, Z. J. Zhu, Phys. Rev. E 64, 017101 (2001). 

[28] Y. Chang, P. Zhang, L. Mao, Z. Gong, in Proceedings of Traffic and Granular Flow 05, (2005). 

[29] L. Li, F. Wang, in Lecture Notes in Computer Science 4153, 105 (2006). 

[30] Y. Su, Z. Wei, S. Cheng, D. Yao, Y. Zhang, L. Li, Z. Zhang, Z. Li, in Transportation Research 

Board Annual Meeting CD, (2008). 
[31] C. W. Gardiner, Handbook of Stochastic Methods for Physics, Chemistry and the Natural 

Sciences, (Springer- Verlag, New York, 1983). 

15 



